FEATURE: Add spending metrics to AI usage #1268
Conversation
You currently cannot access the seeded model edit page, so there's no need to conditionally show certain elements based on if it's seeded. This commit removes those conditional checks. Additionally, it redirects the route if the model is seeded to avoid accessing it via the url.
keegangeorge
changed the title
|
Can you share a screenshot of how it looks when the costs are nil ? Both the form and the usage page |
|
@awesomerobot do you want to do a pass on the form? |
@xfalcox The form just has blank input. And the usage page shows $0, but I have this tooltip: |
I wonder if we should hide the total box and the columns when it's all zeroes... On one hand it showcases the feature so people know that they can fill that, on the other hand it may be just noise if no ones fills it. |
I was thinking about this too, but we would also have to account for the case where models have a cost metric assigned through the form, but with lack of usage there is a $0 estimated cost. So in that case, the box should probably appear and show $0. I thought it'd be simpler just to leave it always there and have the tooltip. But I'm open to changing if we prefer otherwise. |
🔍 Overview
This update adds metrics for estimated spending in AI usage. To make use of it, admins must add cost details to the LLM config page (input, output, and cached input costs per 1M tokens). After doing so, the metrics will appear in the AI usage dashboard as the AI plugin is used.
📸 Screenshots